Skip to main content

View Post [edit]

Poster: QDB Productions Date: Oct 3, 2018 12:47pm
Forum: opensource_movies Subject: Urgent - To Mr. Jeff Kaplan

Hello, I have recently updated my item at: http://archive.org/details/fefdba using bittorrent, as unfortunately my connection is slow and unstable. The task completed successfully after about 33 hours.

When the derive ended and the new files appeared on the "Download Options" menu, I logged in again as I have to rename/delete/rearrange some of the files, but, strangely, the menu shows "No files available" (they reappear right after I log off, though!) and If clean the browser cache and then enter the file manager, there's no trace either of the new files, even though I can see them if I type: http://archive.org/download/fefdba

I've uploaded a small image to see if perhaps, updating the item again would solve the problem, but it got worse! Now, the server at: http://ia802603.us.archive.org/15/items/fefdba/ still shows the new files while the one at: http://ia902603.us.archive.org/15/items/fefdba/ doesn't anymore (yesterday they were present on both servers, even though I couldn't access them through the manager).

I kindly ask you if there's a way to preserve the updated files before the server eventually deletes them by accident, especially the 6.4Gb mp4, which is a bilingual copy of the documentary, intended to replace the zip files, as uploading it again would require a large amount of time.

Thank you very much in advance for your kind attention,
QDB Productions

Edit (about two hours later): seems like every copy of the updated files is now gone. :(

This post was modified by QDB Productions on 2018-10-03 19:47:49

Reply [edit]

Poster: QDB Productions Date: Oct 3, 2018 4:17pm
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

While waiting for your kind answer, I've been trying to guess what happened. Perhaps, files uploaded through the torrent protocol are hosted on a different server and linked to the main one but cannot be accessed directly by users through the item's file manager?

If so, it would make sense that the upload of a newer file caused the subsequent overwriting of the torrent content, rather than inclusion of the new material. Assuming the files are gone forever (unless there's a further backup somewhere) I take the opportunity to ask another question:

In case I'd take the time to start all over again, is there a way to gain access to the new files, after the torrent upload has completed its task? If not, may I ask you to kindly make them accessible, if that is even possible?

Unfortunately, I cannot upload this huge archive (6.4Gb) through different means, as my connection is too slow and the bittorrent protocol ensures a successful outcome, as it can be paused/resumed (is there a timeout for this?) and the checksum prevents file corruption.

Thanks again for your time,
QDB Productions

Reply [edit]

Poster: Jeff Kaplan Date: Oct 4, 2018 10:07am
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

i do not see a 6.4Gb file in the item so the upload likely failed. if the torrent upload succeed the files should be visible and usable in the item.

Reply [edit]

Poster: QDB Productions Date: Oct 4, 2018 10:46am
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

The files were *actually* present on both servers, after the torrent upload ended, at the time I wrote the first message (I think I should've taken a screenshot) but, as I've thoroughly explained before, I inexplicably couldn't access them through the file manager after the derive completed successfully, so I've uploaded a picture to my item to see if maybe this would help updating the files list, but instead the system took the files I had available through the item's manager and overwrote the ones I had recently uploaded, one server at a time. Since you couldn't probably read my request until today, there's nothing left anymore as the unwanted operations ended successfully, as I have stated above.

I hope I could get an answer by the end of this week, concerning the torrent-related questions in my second post above: the files I need to upload are for a presentation in the local municipality about the preservation of our native species and I have some urgency. Thank you very much for your time.

QDB Productions

Reply [edit]

Poster: Jeff Kaplan Date: Oct 4, 2018 10:57am
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

please write specifically your question.

Reply [edit]

Poster: QDB Productions Date: Oct 4, 2018 11:08am
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

Ok (I copy/paste them from my post above):

1. In case I'd take the time to start all over again, is there a way to gain access to the new files, after the torrent upload has completed its task and the derive ends? (I couldn't see the new archives in the item manager even though they were readily downloadable since hours).

1a. If not, may I ask you later to kindly make them accessible/editable for me, if that is even possible?

2. Is there a timeout for bittorrent upload (e.g. if I lose the connection and/or pause the torrent for a while)?

Thank you,
QDB Productions

This post was modified by QDB Productions on 2018-10-04 18:08:34

Reply [edit]

Poster: Jeff Kaplan Date: Oct 4, 2018 12:27pm
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

it appears the 6.4GB of data did successfully upload but it is in the form of 16 zip files. we do not have a way to stitch those together. you would need to upload a single movie format file if you expect it to be playable.

Reply [edit]

Poster: QDB Productions Date: Oct 4, 2018 12:33pm
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

Thanks, but those zip files were already there since 2015 (please, check the timestamp), since it was the only way for me to upload such a big amount of data, and they are now obsolete (thus the new upload, since I've discovered a reliable way to do it through bittorrent).

If I start the upload over again and assuming I couldn't edit/rename/rearrange the new files after the derive as it already happened two days ago, may I ask you later to kindly unlock them in case?

Also, as asked before: is there a timeout for bittorrent uploads here at the Internet Archive (e.g. if I lose the connection and/or pause the torrent for a while)?

Thanks for your kind answer.
QDB Productions

Reply [edit]

Poster: Jeff Kaplan Date: Oct 4, 2018 12:43pm
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

interruption would need a restart of the derive task. the timeout can be for several days and the upload still succeed if the derive task is restarted.

i'm not sure what new files you are referring to. if they were there we would not have deleted them. they are not locked from you since you are the uploader.

Reply [edit]

Poster: QDB Productions Date: Oct 4, 2018 12:48pm
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

Thank you, so I could have the archive's Transmission client upload my torrent content, and if I pause my client or have connectivity problems I could just restart the derive task to resume from where it was interrupted, is it right?

The files I'm referring to are now gone, but I swear they were there (please, check this log: https://catalogd.archive.org/log/1012868025 and search for: "FEFDBA Project [spa-ita].mp4"). They were downloadable after the upload/derive, but the item manager didn't show them. After I've uploaded an image to see if this would update the list, they've been completely overwritten (here's the related log: https://catalogd.archive.org/log/1016120670).

QDB Productions

Reply [edit]

Poster: Jeff Kaplan Date: Oct 4, 2018 1:24pm
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

we're investigating. there is some weird behavior. we do see that the file was in the system at some point. i'll update you as soon as i know more.

Reply [edit]

Poster: Jeff Kaplan Date: Oct 4, 2018 1:31pm
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

ok. we see multiple checkin tasks. if you were uploading on one computer and doing those checkout/checkins on another you may have inadvertently deleted the file(s).

the torrent no longer seems to be in the item. if you upload it to the item we can try to run it and grab the file.

Reply [edit]

Poster: QDB Productions Date: Oct 4, 2018 1:41pm
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

Tank you very much for your help, Mr. Kaplan. I'll upload the torrent again within the next few days, and after its content will be added to my item, I'll see if it shows up correctly on the file manager.

In case that I would still encounter the same problem, I'll drop you a message here to let you know and see if it could be solved, this time *before* doing anything that could inadvertently overwrite the files.

Sincerely,
QDB Productions

Reply [edit]

Poster: Jeff Kaplan Date: Oct 4, 2018 1:48pm
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

also, the torrent should not be deleted from the item. if you did that it would explain why the files disappeared.

Reply [edit]

Poster: QDB Productions Date: Oct 4, 2018 2:11pm
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

Ah, I see. A question, then: what if I rename the files right after they've been uploaded (to disconnect them for the torrent)? May I delete the original *.torrent archive then, or would this still cause the deletion of the related files?

Reply [edit]

Poster: Jeff Kaplan Date: Oct 4, 2018 2:20pm
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

no. renaming them will not change that they are derivative files.

Reply [edit]

Poster: QDB Productions Date: Oct 8, 2018 5:06pm
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

The operation has been successful! Thanks to arthur@archive.org for making the new files available for editing. Archive updated. :)

Reply [edit]

Poster: QDB Productions Date: Oct 4, 2018 2:40pm
Forum: opensource_movies Subject: Re: Urgent - To Mr. Jeff Kaplan

Ok, thank you. I'll keep you informed in case I'll encounter the same problems as before.